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The phase transition from a topological insulator to a trivial band insulator is studied by angle- 
resoled photoemission spectroscopy on Bi 2 -a;Ina:Se 3 single crystals. We first report the complete 
evolution of the bulk band structures throughout the transition. The robust surface state and the 
bulk gap size (~ 0.50 eV) show no significant change upon doping for x = 0.05, 0.10 and 0.175. 

At a; > 0.225, the surface state completely disappears and the bulk gap size increases, suggesting 
a sudden gap-closure and topological phase transition around x ~ 0.175—0.225. We discuss the 
underlying mechanism of the phase transition, proposing that it is governed by the combined effect 
of spin-orbit coupling and interactions upon band hybridization. Our study provides a new venue to 
investigate the mechanism of the topological phase transition induced by non-magnetic impurities. 

PACS numbers: 73.20. At, 71.70.Ej, 71.70.Gm 


Topological insulators (TIs), principally three- 
dimensional (3D) topological crystals, have attracted 
much attention and led to an upsurge in finding new 
topological phases of matter. Extensive theoretical and 
experimental work has been carried out on both the ro¬ 
bust surface state (SS) and topological properties of the 
bulk bands. This body of work now allows distinguish¬ 
ing a TI from a “trivial” band insulatorii^— Further, 
the mechanism of the transition between these two 
classes of insulators, found by substituting non-magnetic 
impurities, has been proposed to be a homogeneous 3D 
topological phase transition (TPT) scenario, i.e., the 
so-called linear gap-closure scenario, suggesting that the 
bulk gap is determined by the spin-orbit coupling (SOC) 
alone, and thus would decrease monotonically along 
with the decreasing SOC strength in the non-trivial 
phase. This transition happens when the bulk gap closes 
and an inversion of the bulk conduction band (CB) and 
valance band (VB) occursji‘^di.2S 

Practically, the 3D TPT induced by non-magnetic im¬ 
purities could only be realized in few real systems, mainly 
TlBi(Si_a:Sea ;)2 and Bi2_a:Ina:Se3. For TlBi(Si_ 2 ,Sea:) 2 , 
the existence of a critical point between the TI TlBiSe 2 
and the trivial metal TlBiS 2 is observedi^^— Upon dop¬ 
ing, an unexpected surface bandgap, i.e., the Dirac gap, 
is observed near the TPTi ^^i^^i^® For Bi 2 _xInxSe 3 , a 
broader TPT from TI to trivial insulator is reported, as 
suggested by transport and photoemission measurements 
on Bi 2 _xIna;Se 3 thin filmsi^^— This linear gap-closure 
scenario motivates a study to characterize the evolution 
of the bulk bands of these two systems so as to fully 


understand the TPT i^^d® While the SS has been char¬ 
acterized, observation of these bulk band features have 
not yet been reported. Therefore, to date, the underly¬ 
ing mechanism of non-magnetic-impurity-induced TPT 
still remains elusive. In order to obtain a much clearer 
insight into the mechanism, we performed systematic 
high-resolution angle-resoled photoemission spectroscopy 
(ARPES) measurements on Bi 2 _a;In 2 ,Se 3 single crystals, 
focusing on the detailed evolution of both the bulk bands 
and the SS during the TPT. 

In this paper, we report an observation of the phase 
transition from a TI to a trivial insulator in Bi 2 _a;Ina;Se 3 
single crystals with various nominal doping levels [x = 
0.05, 0.10, 0.175, 0.225 and 0.30). We demonstrate that 
the bulk gap size 0.50 eV) shows no significant change 
in the topologically non-trivial region {i.e., x = 0.05, 
0.10 and 0.175), instead of a linear gap-closure behav¬ 
ior. The bulk gap appears to abruptly close at a specific 
doping level (~ 0.175—0.225) accompanied by the com¬ 
plete suppression of the SS. After the TPT, the bulk gap 
size increases for x = 0.225 and 0.30. Both the SOC 
and interactions upon band hybridization are suggested 
to cooperate in this local phase transition. 

High quality single crystals of Bi 2 _a;In 2 ,Se 3 were grown 
by slowly cooling a stoichiometric mixture of high purity 
elements of Bismuth, Indium and Selenium in an evac¬ 
uated quartz tubei^ ARPES measurements were per¬ 
formed at Renmin University of China and Institute 
of Physics, Chinese Academy of Sciences, with a He- 
discharge lamp and at the 1-cubed ARPES end station 
at BESSY using synchrotron radiation. The overall an- 
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gular and energy resolutions are better than 0.2° and 5 
meV, respectively. Samples were cleaved in situ yielding 
flat (001) surfaces, and measured at T 10 K, with a 
pressure better than 4 x 10“^^ Torr. 
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FIG. 1. (Color online) (a) Bulk BZ and its surface projection 
of Bi 2 -a:Ina:Se 3 . (b) Core level photoemission spectrum {hv 
= 100 eV) of a; = 0.05. The inset is zoom in of the VB from 
the dashed box. (c) ARPES intensity plot [hu = 70 eV) of x 
= 0.05 at FIf as a function of the 2D wave vector. The inten¬ 
sity is obtained by integrating the spectra within ±15 meV 
with respect to Ef- Cut^l indicates the PM direction, along 
which the data are presented in Fig. [2] The white dashed 
circle is guide to the eyes, served as the FS. 


The schematic bulk Brillouin zone (BZ) of Bi 2 _a;Ina;Se 3 
is presented in Fig. [TJa). As is shown in Fig. [IJb), well- 
defined peaks in the core level photoemission spectrum 
of a; = 0.05 demonstrate the high quality of the series of 
crystals used in this work. One can obtain insight of the 
binding energy within ^ 20 eV below Af in the core level 
spectrum, as shown in the inset of Fig. [Ifb). Fig. [TKc) 
shows the Fermi surface (FS) mapping data oi x = 0.05 
as a function of in-plane wave vector. 

Fig.HIa) shows the band dispersions of series of doped 
samples along the FM direction, indicated via cut#l in 
Fig.inc). The corresponding second derivative plots are 
shown in Fig. [IKb). The data were collected using an 
incident photon energy of 20 eV, ensuring the kz posi¬ 
tions close to the bulk F pointAlso, we verify the 
kz dispersion of the band features by performing photon- 
energy-dependent measurement (see Supplemental Mate¬ 
rial Part 1)<^ The plots in Fig. [^a) clearly show the SS 
for X < 0.175, thus indicating a topologically non-trivial 
region, and the absence of the SS for x > 0.225, thus 


indicating a topologically trivial region. This could be 
further confirmed by the MDGs of x = 0.175 and 0.225 
shown in Figs. He) and Hd) ; respectively. The purely 
flat curves #1, #2 in Fig. [2Kd) are in great contrast to 
the well-dispersed spectra #l-#4 in Fig. [SJe) from the 
linear dispersion of the SS. Due to the absence of the SS, 
the spectra #3, #4 in a: = 0.225 [Fig.j^Kd)] could be rea¬ 
sonably assigned as the band dispersions of VB, with ^3 
near the valance band maximum (VBM) and ^4 deep in 
the VB. These band assignments are discussed in more 
detail in Supplemental Material Part l4i 

Furthermore, one can see the evolution of the bulk 
bands from Figs.^^-) andHb). The bulk gap is defined 
as the difference between the conduction band minimum 
(CBM) and the valley of VB at f point for the topo¬ 
logically non-trivial region. The difference between the 
CBM and VBM is used for the topologically trivial re¬ 
gion. In the topologically non-trivial region, the magni¬ 
tude of bulk gaps reveal binding energies of 0.48, 0.50 
and 0.49 eV for x = 0.05, 0.10 and 0.175, respectively, 
indicating no significant change upon doping. The valley 
structure in VB, caused by the band inversion, gradu¬ 
ally weakens along with the increasing doping, demon¬ 
strating the decrease of SOC strength. This is quantita¬ 
tively proven by the momentum of the bending band {5k) 
around the VBM, as marked by solid arrows in Figs.^Ja) 
and[2Ib). The absolute values of dfc’s are 0.091, 0.073 and 
0.060 for x = 0.05, 0.10 and 0.175, respectively. In 
the topologically trivial region, the band inversion dis¬ 
appears and the valley structure vanishes. The increase 
of the direct band gap indicates the further decrease of 
SOC strength] Considering the evolution of both the 
SS and bulk band structures, we anticipate that a local 
phase transition characterized by a sudden gap-closure 
happens close to a: ^ 0.175—0.225. Another observation 
is the Dirac point (DP) moving toward the CBM with 
the increasing doping. These can be expected to merge 
at the critical point, which also confirms the existence of 
a TPT^i^ 

The extracted evolution of the bulk gap is shown in 
Fig. Hs-)- Th® gS'P size has a dramatic transformation 
between x = 0.175 and 0.225, as shown in the shadow 
region of Fig. H^'), suggesting a critical transition. This 
behavior is in contrast to the mild change for x = 0.05, 
0.10 and 0.175 (defined as negative values to distinguish 
from that in the topologically trivial phase). After cross¬ 
ing this apparent critical point, a strong increase from x 
= 0.225 to 0.30 is observed. This bulk gap evolution de¬ 
viates from that of the linear gap-closure scenario. The 
evident deviation shows that the underlying microscopic 
mechanism of TPT could not be simply elucidated by a 
SOC dominant effect. This first systematic observation 
of the bulk band structure evolution suggests a very new 
mechanism is present. 

As proposed in Ref. 17, a band inversion is induced by 
SOC for a 3D TI. In the topologically non-trivial region, 
after turning on the SOC, there is a downward and up¬ 
ward shift of the CB and VB, respectively, causing the 
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FIG. 2. (Color online) ARPES intensity plots (a) and the corresponding second derivative plots (b) of Bi 2 -a;Ina;Se 3 along f M 
direction {hv = 20 eV). The nominal composition value is noted above each representative plot. The CBM, VBM, DP, valley 
and Sk’s are marked by green, blue, red, white dashed lines and solid arrows, respectively, the red dashed curves represent the 
bulk bands. Band dispersions are quantitatively determined by energy distribution curves (EDCs) and momentum distribution 
curves (MDCs) analysis and overlaid with the second derivative plots, (c) and (d) show the corresponding MDC plots of a; = 
0.175 and 0.225 from (a), respectively. Spectra at the binding energies of -0.248, -0.297, -0.366 and -0.460 eV, as indicated by 
black dashes in (a), are highlighted by thick black curves. Blue dots in (c) are guides to the eyes for the valley structure. 


band inversion and they hybridize with each other around 
r point. Further, the bulk gap would be expected to re¬ 
open owing to the interactions within the overlap. Mean¬ 
while, our observed bulk gap behavior also indicates that 
the reopened bulk gap at F point (be., the gap between 
the CBM and the valley) is no longer dominated by SOC 
alone. Therefore, the combined effect of both SOC and 
interactions upon band hybridization should be taken as 
the determinant during the TPT. 

It is possible to estimate the relative contribution from 
SOC and band hybridization. The overlap ratio (A 5 ) be¬ 
tween the CB and VB after turning on the SOC is, As 
= \Eg — Esoc\, where Eg is the energy gap between the 
CBM and VBM before turning on the SOC and propor¬ 
tional to the covalent bonding strength within the quin¬ 
tuple layer^H and E 50 C is the total energy shift of the 
CB and VB caused by the SOC. As the SEs of VB are 
exactly the momentum of the crossing points between the 
CB and VB when overlapping, thus, after the reopening, 
the indirect gap between the CBM and VBM [as shown 
in Fig. [2][a)] is defined as the hybridization gap {Ah). 
Therefore, we suggest that. As, which corresponds to the 
relative strength of SOC, and Ah, which characterizes 
the interactions within the overlap, together modulate 
the evolution of bulk gap in the topologically non-trivial 
region. In the topologically trivial region, the band in¬ 
version vanishes and along with the band hybridization 
{Ah = 0). As a consequence, the increase of the bulk 


gap size is directly attributed to the decrease of SOC 
strength, i.e., As, upon In dopingi ^’^d^ 

As is schematically illustrated in Fig.|31[b), we estimate 
A 5 as follows: first, extracting the 5Es of VB, shown as 
black vertical arrows; second, extrapolating the high en¬ 
ergy band dispersion to recover the unperturbed VB, and 
fitting the valley structure to get the unperturbed CB, 
shown as red dashed and purple solid curves, respectively; 
last, by shifting the unperturbed CB upward and match¬ 
ing the crossing points, SEs, between the unperturbed 
CB and VB, we recover the overlap as the shadow area 
in the left panel. The energy difference between the ex¬ 
treme values of the red and green dashed curves is defined 
as As- (See more details in Supplemental Material Part 
2 ^) 

In Fig. EKc), the evolution of As and Ah are plotted 
as a function of In concentration. They have remark¬ 
ably different tendencies in the topologically non-trivial 
phase, in which, upon In doping. As decreases monoton- 
ically, while Ah shows no noticeable change. We now 
discuss the possible combination of A 5 and Ah in de¬ 
termining the bulk gap size and thus try to understand 
the underlying mechanism of TPT. From a simple per¬ 
spective, the bulk gap value is the summation of Ah and 
the difference between the VBM and the valley. There¬ 
fore, a reasonable estimate of the bulk gap (A^) using 
the experimental As and Ah values is, A^ ss A • As + 
Ah, in which the factor A characterizes the contribution 
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FIG. 3. (Color online) (a) The evolution of the bulk gap size 
at f point. The definition of bulk gap in two phases are shown 
in the insets. The critical point is within the shadow region, 
(b) A schematic picture of bulk bands in band hybridization 
(left panel) and gap-reopening (right panel) in the topologi¬ 
cally non-trivial phase. The Sk’s (black vertical arrows), un¬ 
perturbed VB (red dashed curve), unperturbed CB (purple 
solid curve) and shifted CB (green dashed curve) are indi¬ 
cated to enable an estimate of As- (c) As (red solid square) 
and Ah (blue open circle) as a function of x in the topolog¬ 
ically non-trivial phase. The evolution of the estimated bulk 
gap, A_b « A-As + Ah (A = 0.4) (green open triangle), upon 
doping is shown in the inset, (d) The doping dependence of 
the ratio of the enclosed FS area to the whole BZ. 


from SOC. In the topologically non-trivial region, A = 
0.4, and in the topologically trivial region, A = 1.0. By 
noticing that Ah 0.4 eV and As ^ 0.1—0.2 eV in 
the topologically non-trivial phase, the gap size is seen 
to be dominated by Ah according to this formula. As a 
result, although As decreases faster along with increas¬ 
ing doping, the gap size changes slightly [as presented 
in the inset of Fig. EKc)] at low In concentrations until 
the band inversion vanishes. Beyond the critical point, 
Ah vanishes, thus the bulk gap is directly determined by 
the SOC strength, which decreases monotonically along 
with the increasing In concentration. This scenario rea¬ 
sonably addresses our observed bulk gap evolution, and 
offers an important insight into the mechanism of TPT. 
Considering the behavior of Ah, we give a reasonable 
speculation here. According to the first-principles calcu¬ 
lations of Bi 2 _a;InxSe 3 proposed in Ref. 33, in the topo¬ 
logically trivial region, the CBM is composed of the Bi 
6p and In 5s orbitals. Both of these orbitals are involved 
in the overlap between the CB and VB in the topologi¬ 
cally non-trivial region. As the interactions upon band 
hybridization are proportional to the density of states 
(DOS) within the overlap, and considering the DOS is 
intimately connected with the overlap ratio. Ah may be 
expected to decrease along with the decreasing A 5 in 
common sense. However, our observed nearly invariant 
Ah possibly indicates the non-negligible contribution of 


the increasing In 5s orbital in modulating the DOS within 
the overlap. 

We estimate the carrier concentrations of our samples 
by calculating the ratios of the enclosed FS area to the 
whole BZ and present them in Fig. [SKd). This ratio de¬ 
creases monotonically with increasing doping, agreeing 
well with the transport results proposed in Ref. 26. 

A schematic picture of the band structure evolution 
during the TPT is conceptually sketched in Fig.|4l In the 
topologically non-trivial region (x < Xc), the band inver¬ 
sion exists, thus the interactions upon band hybridiza¬ 
tion and SOC together modulate the bulk gap size. As 
a result, the bulk gap shows no significant change. With 
the increase of In doping, the overlap ratio between the 
CB and VB decreases. At the critical point (x = Xc), 
the band inversion vanishes and so does the band hy¬ 
bridization, the bulk gap collapses accompanied by the 
vanishing of the SS. In the topologically trivial region 
(x > Xc), the further decreasing SOC strength separates 
the CB and VB, giving rise to the increase of bulk gap. 
The DP moves toward the CBM with the increasing dop¬ 
ing, and the extrapolated merging point is at the vicinity 
of Xc- This behavior can be explained as a result of the 
reduction of the inverted band overlap ratio between the 
CB and VB. 



FIG. 4. (Color online) A schematic picture of the band struc¬ 
ture evolution of Bi 2 -xIna;Se 3 as a function of In concentra¬ 
tion. The different colors of the bulk bands represent different 
orbital characters and parities. 

To summarize, we have performed ARPES experi¬ 
ments on Bi 2 _xIna;Se 3 single crystals to study the band 
structure evolution of the TPT induced by non-magnetic 
impurities. We report the evolution of the bulk bands 
throughout the transition, and propose a sudden gap- 
closure behavior across the phase transition, instead of 
the linear gap-closure scenario dominated by SOC alone. 
Our study suggests that the interactions upon band hy¬ 
bridization and SOC together determine the TPT, pro¬ 
viding a novel perspective on the underlying mechanism. 
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